Research on Strategy of Load Balancing in Distributed ETL

doi:10.3969/j.issn.1006-2475.2011.09.054

Computer and Modernization ›› 2011, Vol. 193 ›› Issue (9): 201-204.doi: 10.3969/j.issn.1006-2475.2011.09.054

• 应用与开发 • Previous Articles Next Articles

Research on Strategy of Load Balancing in Distributed ETL

ZHANG Liang ¹, XIA Xiu-feng²

1.Vocational and Technical School of Shenyang Pharmaceutical University, Shenyang 110026, China;2.School of Computer Science and Engineering, Shenyang Aerospace University, Shenyang 110136, China

Received:2011-05-03 Revised:1900-01-01 Online:2011-09-22 Published:2011-09-22

Abstract

Abstract: After analyzing the importance of load balancing in distributed ETL, aiming at the limitation of traditional ETL used in distributed data warehouse, a new strategy that the data extracted from ETL node are divided according to the type of data is proposed, and then presents a new model of load balancing R-CN model that is combined by chain network model and Routers. On the basis of that presents a new load balancing strategy based on the data segment strategy and R-CN model. The strategy improves the ability of data processing greatly, and it also effectively increases the efficiency of distributed ETL.

Key words: distributed data warehouse, ETL, data partitioning, load balancing

CLC Number:

TP311

ZHANG Liang;XIA Xiu-feng. Research on Strategy of Load Balancing in Distributed ETL[J]. Computer and Modernization, 2011, 193(9): 201-204.

[1]	YANG Yufeng1, 2, XIA Xiaoyun2, CHEN Zefeng3, LIAO Weizhi2, LI Jiwu2. Dung Beetle Optimization Algorithm Integrating Multiple Strategies for Take-out Order Distribution Route Optimization [J]. Computer and Modernization, 2024, 0(09): 25-32.
[2]	QIU Ling1, 2, SONG Zhi1, 2, LYU Shuang1, 2, YANG Xue1, 2. Application of Data Synchronization Technology in External Services of Meteorological Big Data Cloud Platform [J]. Computer and Modernization, 2024, 0(07): 76-81.
[3]	FENG Xian1, 2, FANG Kun1, QU Youming1, LIU Xiaobo1, SHI Jiachi1, WEN Liheng1. Research and Application of Key Technologies in Meteorological Service Middle Platform [J]. Computer and Modernization, 2024, 0(05): 69-74.
[4]	WANG Chong-yang, ZHUANG Yi. Load Balancing Algorithm of Multi-job Cluster Based on SDN and Improved CSA Algorithm [J]. Computer and Modernization, 2023, 0(11): 28-35.
[5]	FENG Zeng-xi, CHEN Hai-yue, WANG Tao, ZHAO Jin-tong, LI Shi-yan. Energy Consumption Prediction of Air-conditioning System in Underground Engineering Based on XGBoost Hyperparameter Optimization [J]. Computer and Modernization, 2023, 0(01): 108-113.
[6]	YUAN Jia-li, LIU Meng-chi. Dynamic Data Partition Algorithm for Information Network Model [J]. Computer and Modernization, 2022, 0(10): 100-105.
[7]	NI Ya-ting, YANG Wen-hui, MIAO Fang, HUANG An-qi, JIANG Yuan. Dynamic Load Balancing Strategy of DRC Cluster Based on Nginx [J]. Computer and Modernization, 2022, 0(04): 58-64.
[8]	DUAN Peng-fei, LAN Ru. Design of Network-level Moving Target Defense System Based on Blockchain [J]. Computer and Modernization, 2021, 0(08): 121-126.
[9]	LI Juan. Dynamic Load Balancing Algorithm for Heterogeneous Clusters Based on Internet of Things Technology#br# [J]. Computer and Modernization, 2021, 0(04): 104-108.
[10]	YAN Yi, ZHOU Kai-dong, LIN Xi-jun, MAI Xiao-hui, XIAO Jian-yi, ZENG Zhao-lin. Fault Location Algorithm for Electric Power Marketing System Based on Causal Rules [J]. Computer and Modernization, 2020, 0(03): 13-.
[11]	WEN Ting-ting, LI Hong-zhe. Elastic Load Balancing Algorithm for Cloud Computing Service [J]. Computer and Modernization, 2019, 0(10): 28-.
[12]	LI Yong-gang1, YUE Wen-tao1, LI Long-jiang2. A Load-balancing Algorithm in Overlapping System of TD-LTE and eHRPD [J]. Computer and Modernization, 2017, 0(5): 5-9.
[13]	LUAN Zhi-kun1, NIU Chao2. A Load-balanced Virtual Machine Scheduling Approach in Cloud Data Center [J]. Computer and Modernization, 2017, 0(5): 24-36.
[14]	ZHANG Nan, CHAI Xiao-li, XIE Bin, TANG Peng. Realization of Load Balancing Mechanism in Storm Streaming Processing Platform [J]. Computer and Modernization, 2017, 0(12): 65-70+76.
[15]	RAN Xun， YUAN Jianhua， LIU Yuguo， HU Yang. An Invoice Management System Based on Load Balancing [J]. Computer and Modernization, 2016, 0(10): 121-.

Research on Strategy of Load Balancing in Distributed ETL

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

Comments